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REMOTE TABLET -BASED INTERNET INSPECTION SYSTEM 



BACKGROUND OF THE INVENTION 

( 1) Field of the Invention 

The present invention relates to a system for remotely 
monitoring a deployed product, gathering data about the 
deployed product, and disseminating the data to interested 
parties. More specifically the present invention is drawn to 
a system for enabling remote acguisition of visual data via a 
wireless LAN and internet architecture and interactively 
making use of such data. 

(2) Description of Related Art 

There exists in industry dedicated servers forming 
portals through which communities of users may communicate 
with one another. Often times, users sharing a common 
attribute may have partitioned access to subsets of the data 
contained upon the server. For example, engineers might form 
a community of users with restricted access to engineering 
data and may be capable of entering a chat room hosted on the 
server. When such a portal is in communication via the 
internet with other servers having unigue IP addresses, users 
of the portal may gain access to servers located around the 
world. 

There also exists a need for individuals or groups of 
individuals to access information related to various 
apparatus. For example, aerospace engineers engaged in the 
design and testing of aircraft engines have a need to receive 
detailed data related to the condition and performance of 
engines deployed in the field. In particular, it would be 
useful to receive detailed visual data related to the 
condition of an engine or other apparatus and to interactively 
direct the acguisition of such data. Unfortunately, it is 
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often both time consuming and expensive to gather such data 
from deployed apparatus. 

There therefore exists a need for a system to allow 
remote users of a portal architecture to gain access, via a 
network, to devices capable of acquiring visual data related 
to the condition and performance of deployed apparatus 
wherever they are located. There additionally exist a need 
for users of such a system to be able to interactively issue 
control commands capable of guiding the acquisition of such 
visual data. 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to 
provide a system for remotely monitoring a deployed product, 
gathering data about the deployed product, and disseminating 
the data to interested parties. 

An additional object of the present invention is to 
provide a system for enabling remote acquisition of visual 
data via a wireless LAN and internet architecture and 
interactively making use of such data. 

Yet another object of the present invention to provide an 
integrated system comprising a portal, a server communicating 
with the portal and at least one local area network, at least 
one mobile platform in wireless communication with the at 
least one local area network, and a means for enabling two-way 
communications between the portal and the server. 

It is another object of the present invention to provide 
a method for providing remote, interactive visual analysis of 
an apparatus, comprising the steps of providing a portal, the 
portal in communication with at least one electronic device, 
providing a server in two-way communication with the portal 
via the internet, integrating the server into a wireless local 
area network, connecting at least one mobile platform to the 
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local area network, providing visual data from at least one 
visual device to the at least one mobile platform, and 
receiving the visual data at the at least one electronic 
device . 

BRIEF DESCRIPTION OF THE DRAWINGS 
The Figure A schematic diagram of the integrated system of 

the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT ( S ) 
Referring now to the Figure, a system 10 is presented 
which is capable of remotely monitoring a deployed product, 
gathering data about the deployed product, and disseminating 
the data to interested parties. Of particular note is the 
ability of system 10 to remotely acquire visual information 
pertaining to a deployed product, to allow for the remote 
viewing of such visual data, and to provide two-way 
communications between the viewer of such data and the 
instrument acquiring the data. System 10 is also capable of 
monitoring and restricting interested parties' access to its 
data, and can transmit command instructions from a remote 
viewer to alter the operation of the visual data acquiring 
instrument. As used herein, the term "deployed product" has 
broad applicability and refers to any product, component, or 
system. For example, the deployed product may be a propulsion 
system on a vehicle, a compartment of a vehicle, or a braking 
system for a vehicle. 

The system 10 includes a server 22. As used herein, the 
term "server" refers to any and all devices capable of storing 
and disseminating data to at least one other electronic 
device. The server 22 may be provided with its own web 
address, a firewall, and security protocols known only to 
selected individuals, such as the manufacturer of the deployed 
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product. Examples include, but are not limited to, personal 
computers, microservers, and dedicated servers. 

In a preferred embodiment, server 22 is deployed in a 
stationary structure such as the floor of a hangar or vehicle 
assembly plant. In another embodiment, server 22 may be 
located upon a moveable platform. The movable platform may be 
a boat, an airplane, a spacecraft, an automobile, a truck, or 
any other entity that is movable. 

The server 22 is in communication with wireless LAN 
access point 20. Wireless LAN access point 20 serves to 
create a wireless local area network (LAN) 24. In operation, 
wireless LAN 24 establishes a perimeter about wireless LAN 
access point 20. Electronic devices, including server 22, 
within the perimeter established by wireless LAN 24 may logon 
to wireless LAN 24 and communicate via wireless LAN 24 with 
other electronic devices similarly logged on to wireless LAN 
24. In a preferred embodiment wireless LAN access point 20 is 
physically mated to server 22. In such an instance, wireless 
LAN access point 20 may be, for example, an 802. 11B wireless 
LAN card. However, other examples of wireless LAN access 
point 20 include any and all devices which may be located 
remote from server 22, which can communicate with server 22, 
and which are capable of establishing wireless LAN 24. 

The server 22 may monitor the condition of and/or gather 
data about a deployed product in a number of ways. Server 22 
may be connected via wireless LAN 24 to a mobile device 26. 
In a preferred embodiment, mobile device 26 is a wireless PC 
tablet capable of wireless communication with wireless LAN 24. 
Mobile device 26 may be carried or otherwise moved while in 
communication with wireless LAN 24 and thereby maintain the 
ability to communicate with server 22. Attached to mobile 
device 26 may be a visual data device 32. Visual data device 
32 acguires visual data pertaining to a deployed product and 
communicates the data to mobile device 26. In one embodiment, 
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visual data device 32 is a borescope. In another embodiment, 
visual data device 32 is a stereo image lens capable of 
capturing and communicating stereo images to mobile device 26. 
In a preferred embodiment,, visual data device 32 communicates 
with mobile device 26 through connection 30. Connection 30 is 
a physical connection including, but not limited to, an s- 
video connection or a data feed wire. Connection 30 inputs 
information from visual data device 32 to mobile device 26 via 
input point 28. In a preferred embodiment, input point 28 is 
a USB port integrated into mobile device 26. 

Configured as described, visual data device 32 acquires 
visual data about a deployed product, communicates the data to 
mobile device 2 6 whereby mobile device 2 6 communicates the 
data to server 22 via wireless LAN 24. 

The server 22 may be programmed in any suitable language 
known in the art to gather the data about the deployed product 
and present the data to interested parties in a desired 
format. For example, the server 22 may be used to host a web 
page which provides information about one or more deployed 
products. The web page may have a menu which allows an 
interested party to gain access to gathered data about a 
particular deployed product. The data about the deployed 
product (s) may be organized on the server 22 and presented in 
any desirable format or manner. The server 22 may also be 
programmed to allow an interested party to carry out 
diagnostic operations on the deployed product (s) and/or to 
issue commands to visual device 32 via wireless LAN 24 and 
mobile device 26. 

In accordance with the present invention, the server 22 
is capable of being accessed by interested parties via a 
portal 12 and the Internet or world wide web. To this end, 
the server 22 may have a communications device, such as a 
modem, built within it to allow communication between the 
server 22 and the portal 12. The communication device may 
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allow for radio frequency communications such as cellular 
communication, satellite communication, and/or wireless 
communication between the server 22 and the portal 12. In 
addition, communications between the server 22 and the portal 
12 may be achieved by optical means such as an infrared link. 

The portal 12 is hosted by an external server which may 
be any suitable server known in the art. The server hosting 
the portal 12 also has appropriate communication means 
associated with it to allow it to gain access to and be 
accessed by the server 22. 

The portal 12 may be provided with a number of software 
tools called gadgets to automatically analyze, organize, and 
sort the data which has been received from the server 22. The 
data is preferably sorted so that different communities gain 
access to different portions of the data. For example, actual 
and potential customers of a vendor of a deployed product may 
form one community and have access to certain data, while 
support engineers and product designers may form a second 
community and have access to another form of the data. As can 
be seen from the foregoing discussion, the portal 12 offers 
great flexibility as to how and to whom the data is 
disseminated. One of the advantages to using the portal 12 is 
that its functionality can be carried out in a secure, user 
friendly, web-based environment. Members of a particular 
community can log in by presenting an identification and/or a 
password and gain access to current information about a 
deployed product. 

Another advantage to using the portal 12 is that it can 
be used to receive data from server 22 and to upload 
information and data to the server 22. Thus, an engineer, in 
communication with portal 12, can remotely receive visual data 
pertaining to a deployed product captured by visual data 
device 32 as well as send information to the visual data 
device 32. 
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With continued reference to Fig. 1, there is illustrated 
a plurality of exemplary electronic devices in communication 
with portal 12 which may be utilized to communicate with a 
visual device 32 via portal 12, server 22, wireless LAN 24, 
and mobile platform 26. For example, goggles 14 may be 
utilized by a viewer of visual data captured by visual data 
device 32. Such goggles 14 may facilitate the viewing of 
monographic or stereoscopic visual data captured by a video 
borescope or stereo image lens respectively. Computer 16 may 
be any computing device capable of receiving data and 
displaying it, as for example on a computer screen, and 
issuing commands, as for example through a keyboard associated 
with computer 16. In addition, a mobile computer 18, such as 
a tablet PC, may be used to send and receive data to and from 
visual data device 32. 

While described with respect to goggles 14, computer 16, 
and mobile computer 18, the present invention is broadly drawn 
to encompass any and all means of receiving and displaying 
visual information as well as issuing control commands to 
control the acquisition of such visual data. For example, 
other devices which may be used in communication with portal 
12 to receive and display visual data include 3D auto- 
stereoscopic projection systems, and 3D goggles. 

Having thusly described the interaction of the components 
comprising system 10, there is herein provided a preferred 
embodiment whereby the present invention may be employed and 
utilized. The present invention can provide a live video 
image from a visual data device 32, such as a standard 
borescope, directly connected to a mobile device 26 comprised 
of a wireless PC maintenance tablet. The wireless PC tablet 
can be carried around by a mechanic or the like and may serve 
as the mechanic's repository for work instructions, electronic 
manuals, and the like in a field or shop aerospace 
environment. The mechanic can thereby move freely about the 
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work environment and position the borescope in desired 
proximity to a deployed product such as and aircraft engine 
under repair. The wireless PC tablet is logged on to wireless 
LAN 24 and therefore communicates with server 22. Server 22 
has a unique IP address and is therefore accessible via the 
internet by portal 12. As a result, sections of the PC tablet 
desktop (or the entire desktop) can be shared within the 
Portal architecture, consisting of portal 12 and the 
electronic devices in communication with portal 12, to allow 
for remote viewing, collaboration, and control of the 
borescope equipment between the operator and remote persons, 
such as engineers, managers, and customers sitting at their 
work or home PCs from anywhere in the world via an ordinary 
web browser. 

Alternatively, a web-based application could be used to 
directly control the borescope, provide the image, and allow 
for communications remotely via a web interface. The remote 
control borescope feature builds upon local software-based 
borescope controls developed and sold by Olympus America Inc. 
of Melville, New York, and the Internet eBusiness Portal 
managed by Pratt & Whitney of Connecticut. Note that this 
wireless tablet /Portal system combination allows for a field 
mechanic to have all of the advantages of broadband internet 
connectivity and collaboration support with customer and 
factory personnel, including, static picture, live video, 
voice-over-IP, touchscreen white board, and other PC 
functionalities in a mobile shop or field environment. 

In an alternative embodiment, visual data device 32 
consists of a stereo image lens marketed by Olympus America 
Inc., which provides a left eye-right eye double image. The 
double image data is accessible by remote viewers via a host 
of electronic devices in communication with portal 12 
including, but not limited to, three dimensional, stereo 
viewing devices, such as glasses, goggles, or the 
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autostereographic viewing system now under development by the 
University of Strathclyde in Scotland. Such a configuration 
allows for remote, 3D viewing of the live video image in a 
remote lab or location for in-depth analysis. The remote 3D 
viewing permits natural three dimensional interpretation of 
the subject matter for significantly enhanced viewing and 
diagnostics by a remote person, and has broad applications in 
many other fields besides aerospace, including manufacturing, 
medical, surveillance, pharmaceutical, and other types of 
inspection activities. 

Because the present invention provides two-way 
communication between a visual data device 32 and remotely 
located electronic devices used to view such data, viewers may 
issue control commands to the visual data device 32 based upon 
the visual data they receive. For example, a viewer using 
goggles 14 to view auto-stereoscopic data captured by a stereo 
image lens functioning as visual data device 32, may send a 
command instruction to alter the orientation of visual data 
device 32. Such a command may cause the stereo image lens to 
alter its orientation by zooming in on an engine part or 
panning left or right about a deployed product. In this 
manner, remote viewers of visual data acquired by visual data 
device 32 may analyze visual data as well as direct the 
acquisition of such data. 

Advantages of such a system include allowing multiple 
experts in different locations to quickly and effectively 
collaborate on an inspection of a turbine engine part, then 
make and document a decision that would either remove the 
engine for overhaul or allow for continued operation. The 
savings in time and money would be significant, as presently a 
part requiring inspection would have to wait until the 
appropriate experts could physically travel to the site in 
order to perform the inspection. 
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While described in detail with respect to a stationary 
server 22 located, for example, in an aircraft hangar, the 
server 22 may in an alternative embodiment be located upon a 
moveable platform. One advantage of locating server 22 on a 
moveable platform is to enhance the ability of system 10 to 
provide more flexible remote acquisition of data. For 
example, a moveable platform such as a helicopter could have 
installed upon it a server 22 in internet communication with 
portal 12. The helicopter could be flown to a remote location 
and land amongst one or more deployed helicopters requiring 
diagnostic attention. Wireless LAN 24 is configured to 
encompass the area within which the helicopters reside. As a 
result, mechanics carrying mobile devices 26, such as PC 
tablets, connected to video borescopes can position the 
borescopes to gather visual data of, for example, the 
helicopter's engines. In this manner, remote viewers 
communicating with portal 12 can both receive the visual data 
collected by the borescope and issue control commands to 
interactively examine the engines. 

It is apparent that there has been provided in accordance 
with the present invention a remote tablet-based internet 
inspection portal system which fully satisfies the objects, 
means, and advantages set forth previously herein. While the 
present invention has been described in the context of 
specific embodiments thereof, other alternatives, 
modifications, and variations will become apparent to those 
skilled in the art having read the foregoing description. 
Accordingly, it is intended to embrace those alternatives, 
modifications, and variations as fall within the broad scope 
of the appended claims. 
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